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MOBILE MULTIMEDIA TERMINAL AND HOME GATEWAY REMOTE 
CONTROL METHOD USING SUCH A TERMINAL 

Field of the invention 

The present invention relates to a mobile 
multimedia terminal and a home gateway remote control 
method using such a terminal . 

State of the related art 

The use of a voice recognition module to control 
household equipment is known. However, this module is 
remote from the user. When transmitting an order 
between the user and said voice recognition module, the 
user must repeat the command when the audio, acoustic 
or electrical flux is subject to distortion. In 
addition, exchanges between the control device, which 
includes said voice recognition module, and the user 
are only carried out in voice mode. This results in 
tedious dialogue for the user. 

The aim of the invention is to propose a terminal 
making it possible to resolve such a problem by 
reducing the risks of acoustic or electrical distortion 
of the audio flux and enabling the user to validate a 
voice command considered as ambiguous by the voice 
recognition module. 
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Description of the invention 

The invention relates to a mobile multimedia 
terminal comprising a processor, a program memory and a 
data memory, comprising a voice-activated remote 
5 control device comprising a microphone, a voice 
recognition module, a lexical analyser, and a 
communication module, capable of controlling at least 
one item of household equipment by means of a home 
gateway, via a wireless link. 

10 It may also comprise a manual input device, a 

screen and a speaker. The screen may be a screen 
equipped with touch input properties. The wireless link 
may for example be an IEEE 802.11 type link or a 
"Bluetooth" type link or any other type of radio 

15 transmission link supporting IP protocol. 

The invention also relates to a remote control 
method of a home gateway connected to at least one item 
of household equipment via a home network, by means of 
a mobile multimedia terminal, comprising the following 

20 steps: 

- an actuation step of a terminal input peripheral 
by the user, 

- a transmission step of a voice command by said 

user, 

25 - a reception step of said voice command by the 

terminal , 

a conversion step of the acoustic signal 
received into electrical information, 

- an analysis step of said electrical information 
30 and association of words described in a grammar, 
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a detection step of a correspondence between 
said words and a list of orders permitted by the home 
gateway, 

- a transmission step by the terminal of a warning 
5 that it has not been able to interpret an order, 

- a display step of an order if it exists, 

- a feedback step when the terminal has been able 
to interpret the order, 

- an encoding step of said order according to the 
10 gateway protocol, 

- an integration step of said encoded order into a 
transmission protocol request, L 

- a transmission step of the request to the home 
gateway. 

15 This method may also comprise a display step of a 

reiteration request message for the command in the 
event of ambiguity in its interpretation. 

Advantageously, the method according to the 
invention comprises a control step of functions 

20 relating to at least one item of household equipment or 
intrinsic functions of the home gateway. In this way, 
it may comprise an actuation step of hardware or 
software processes hosted on at least one item of 
household equipment . 

25 Advantageously, the method according to the 

invention comprises a command reiteration step, carried 
out in voice mode or by means of a manual action. 

It is also possible to use an encryption algorithm 
of the information transmitted between the terminal and 

3 0 the home gateway. 



SP 21109 ALP 



The information transmitted between the terminal 
and the home gateway may be in IP format. 

The mobile multimedia terminal according to the 
invention is thus capable of processing acoustic 
5 signals, including the result of the processing in IP 
packets, or any other protocol, transmitting this data 
in real time to a home gateway where it can be 
interpreted, and triggering any of the following 
actions : 

10 - control of equipment connected to said home 

gateway via a local data transmission network, 

- execution of predefined action scenarios to be 
carried out by said gateway, 

- internal notifications to said gateway, 
15 - equipment status request. 

In return, said gateway may transmit to the mobile 
multimedia terminal information in the form of data, 
sound, image or video, indicating: 

- the command processing status, 

20 - notification of alarms and any events relating 

to the home local network or to equipment connected to 
said network. 

Brief description of figures 
25 Figure 1 illustrates the architecture of the 

mobile multimedia terminal according to the invention. 

Figure 2 illustrates the steps of the method 
according to the invention. 

Detailed description of particular embodiments 
3 0 As represented in figure 1, the mobile multimedia 

terminal according to the invention 10, controllable by 
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a local user 1, is a portable information system 
platform particularly incorporating the following 
functional components: a processor 11 to which a RAM 
memory 12, a bank memory 13, a voice recognition 
5 module 14, a lexical analyser 15, and a communication 
module 16 are connected, along with input and output 
peripherals . 

The input peripherals may be a microphone 17, a 
manual input device which may consist of one or more 
10 push buttons. Said device may also comprise a screen 18 
equipped with touch input properties. 

The output peripherals may be such a screen 18 and 
a speaker 19. 

As illustrated in figure 1, said terminal is 
15 connected via a wireless, IEEE 802.11, "Bluetooth" type 
link or any other link using a wireless communication 
standard (network 20) , to a home gateway 21, which 
comprises : 

- an interface 22 with an external network 23, 

20 - an interface 24 with the internal network 20, 

for example, Hertzian, 

an interface 25 with a home local network 26 
comprising sensors or actuators 27 used to control 
household equipment, and multimedia equipment such as a 

25 Hi-fi or video system, 

- an interface 28 to the Internet. 

Said terminal 10 is capable of transmitting 
digital information, for example in IP format, in real 
time to the home gateway 21 via its communication 
3 0 module 16. 
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In the processing example illustrated in figure 2, 
following the transmission of a voice command from the 
user, it is received in the terminal using the 
microphone 17 (step 31) . Said microphone 31 converts 
5 the acoustic signal into electrical information 
(step 32) . 

The voice recognition module 14 analyses this 
electrical information and associates, if applicable, 
words described in a grammar with it (step 33) . 

10 The lexical analyser 15 receives the words 

interpreted by the voice recognition module, locates a 
correspondence between said words and a list of orders 
permitted by the home gateway (step 34) . 

If the order belongs to the list of orders 

15 permitted by the gateway, the words recognised by said 
voice recognition module 14 are sent to the terminal 
screen (step 35) . In the event of ambiguity in the 
interpretation, validation of the words displayed is 
requested from the user (step 36) . 

20 Following step 35, the lexical analyser 15 encodes 

the order according to the protocol of the gateway 21, 
before transmitting said information to the 
communication module (step 37) . 

The communication module 16 integrates the encoded 

2 5 order into a request, for example an "HTTP" request, of 
the transmission protocol, for example IP (step 38) , 
and then transmits the request to the home gateway 21 
via the wireless link 20 (step 39) . 

The mobile multimedia terminal according to the 

30 invention can thus be used for the remote actuation of 
hardware or software processes hosted on one or more 
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items of equipment 2 7 of a home local network 2 6 
connected to a home gateway 21. 

This terminal 10 enables the user to voice-control 
all the remote control functions offered by the home 
5 gateway 21. Said functions may relate to equipment 27 
connected to the home gateway 21 via the data 
network 26 or intrinsic to said gateway 21. An order 
from the user to an item to be controlled contains at 
least two useful items of information: an action and 

10 the name of the item. 

The user may actuate any of the input peripherals 
of the mobile multimedia terminal 10, for example a 
push button on the terminal or an icon on the touch 
screen, before giving an order. This facility reduces 

15 risks of error to only the orders given by the user 
intended for the home gateway 21. 

Advantageously, the terminal according to the 
invention 10 authorises the repetition of orders 
received and interpreted by the terminal 10 either 

20 visually on the screen 18, or by voice synthesis by the 
speaker 19. This feedback enables the user to validate 
or record orders. This feature facilitates the use of 
the remote control by blind or partially sighted users. 
The mobile multimedia terminal 10 can warn the 

25 user when it has not been able to interpret an order 
received. This warning may be an audio or visual signal, 
or an audio message. In addition, the confirmation, 
repetition or reiteration of such an order may be 
performed by the user in voice mode or by means of a 

30 manual action, for example by pressing on a button or 
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on the touch screen of the mobile multimedia 
terminal 10. 

The mobile multimedia terminal 10 makes it 
possible to correct errors liable to result from 
5 Hertzian transmission. Methods well-known to those 
skilled in the art ensure the quality of service that 
can be used on the lower layers ("Bluetooth", IEEE 
802.11, etc.) and upper layers (TCP/IP, UDP/IP, etc.) 
of the transmission protocol. The lower layers are 
10 layers 1 and 2 of the OSI model: the Physical layer and 
Link layer. The upper layers are layers 3 to 6 of the 
OSI model, usually referred to as Network, Transport, 
Session and Presentation layers. 

Finally, the mobile multimedia terminal 10 may 
15 comprise an encryption algorithm of the digital data 
contained in each IP packet so as to certify, render 
confidential and secure the message transmitted between 
said terminal and the gateway 21. 

Said terminal 10 may, for example, be a digital PA 
20 or a larger format graphic tablet used to access home 
or family applications. 

Example of embodiment of terminal according to the 
invention 

25 In an embodiment of the terminal 10, the oven and 

the roller blinds in a home are connected to the home 
gateway 21 and receive from said gateway via the home 
local network 26 the following parameters: start, stop, 
cooking stabilisation and gradient stages. 

30 The user can thus, while sitting in the living 

room, use the voice-activated control of the 
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terminal 10 to find out the progress of the cooking 
cycle and send an order to the oven to stop or reduce 
the temperature so as to delay the time at which the 
dish is removed from the oven. 
5 From the same location, the user can control the 

closure of the blinds without missing any of their 
favourite television programme. 



